TAC2010 Update Summarization and AESOP of ICL
نویسندگان
چکیده
For the guided summarization task of TAC 2010, we submitted two runs using the combination of manifold ranking score and aspects information. The only difference between these two runs is that one computes a score according to aspect information while the other one considers aspect coverage in each sentence. For the update summarization task, we adopt similar methods and simultaneously penalize the information overlap between docset B and docset A. For the AESOP task, we focused on No Models evaluation case and submitted three runs. The first one uses a simple linear combination of three ROUGE scores, including ROUGE-1, ROUGE-2 and ROUGE-SU4, with four human summaries as models. The other two methods extract term information from four human summaries, such as term frequency and model frequency, based on which we evaluate each automatic summary. The difference between these two runs is that one of them introduces more term information, such as bigram information.
منابع مشابه
WB-JRC-UT's Participation in TAC 2009: Update Summarization and AESOP Tasks
In this paper we describe our participation in the Summarization track at the 2009 Text Analysis Conference (TAC). The Summarization track was composed of two tasks: Update Summarization and Automatically Evaluating Summaries of Peers (AESOP). We submitted two runs for the former and four for the latter. In the following sections we describe our runs and discuss the results attained.
متن کاملCLASSY 2009: Summarization and Metrics
This year the CLASSY team participated in the update summary task and made four submissions to summarization evaluation (AESOP). Our AESOP submissions used combinations of ROUGE scores along with an update (or newness) score. We also use these new metrics, which we call Nouveau ROUGE, to help train our system and evaluate new ideas on computing update summaries. CLASSY (Clustering, Linguistics,...
متن کاملPolyU's Experimentation with Guided Summarization
In addition to the familiar tasks of update summarization and automatic summary evaluation, the TAC 2010 summarization track includes a new task: guided summarization. It is designed to “encourage a deeper linguistic (semantic) analysis of the source documents” in order to generate a summary guided by a given set of aspects. The new task is an upgrade of query-focused summarization in that an a...
متن کاملTMSP: Topic Guided Manifold Ranking with Sink Points for Guided Summarization
Guided summarization is an extension of query-focused multidocument summarization. We proposed a novel ranking algorithm, Topic Guided Manifold Ranking with Sink Points (TMSP) for guided summarization tasks of TAC2010. TMSP is a topic extended version of Manifold Ranking with Sink Points (MRSP), which handles the Update Summarization tasks of TAC2009 well. We adopt the TMSP and MRSP methods to ...
متن کاملHMM Content Model for TAC2010 Summarization Challenge
We present the HITS submission for the 2010 TAC Guided Summarization Task. We focus on the main multi-document summarization task, rather than the update task. We implement a baseline extractive summarization system from the literature (Barzilay and Lee, 2004) which uses a Hidden Markov Model to assign sentences content or topic labels, predicts which topics most likely appear in the summary, a...
متن کامل